Graph polynomials and approximation of partition functions with Loopy Belief Propagation
نویسندگان
چکیده
The Bethe approximation, or loopy belief propagation algorithm, is a successful method for approximating partition functions of probabilistic models associated with graphs. Chertkov and Chernyak derived an interesting formula called “Loop Series Expansion”, which is an expansion of the partition function. The main term of the series is the Bethe approximation while the other terms are labeled by subgraphs called generalized loops. In our recent paper, we derive the loop series expansion in form of a polynomial with coefficients positive integers, and extend the result to the expansion of marginals. In this paper, we give more clear derivation of the results and discuss the properties of newly introduced polynomials.
منابع مشابه
A Lower Bound on the Partition Function of Attractive Graphical Models in the Continuous Case
Computing the partition function of an arbitrary graphical model is generally intractable. As a result, approximate inference techniques such as loopy belief propagation and expectation propagation are used to compute an approximation to the true partition function. However, due to general issues of intractability in the continuous case, our understanding of these approximations is relatively l...
متن کاملLoopy annealing belief propagation for vertex cover and matching: convergence, LP relaxation, correctness and Bethe approximation
Abstract—For the minimum cardinality vertex cover and maximum cardinality matching problems, the max-product form of belief propagation (BP) is known to perform poorly on general graphs. In this paper, we present an iterative annealing BP algorithm which is shown to converge and to solve a Linear Programming relaxation of the vertex cover problem on general graphs. As a consequence, our anneali...
متن کاملApproximating the Permanent with Belief Propagation
This work describes a method of approximating matrix permanents efficiently using belief propagation. We formulate a probability distribution whose partition function is exactly the permanent, then use Bethe free energy to approximate this partition function. After deriving some speedups to standard belief propagation, the resulting algorithm requires O(n) time per iteration and seems empirical...
متن کاملSolving Non-parametric Inverse Problem in Continuous Markov Random Field using Loopy Belief Propagation
In this paper, we address the inverse problem, or the statistical machine learning problem, in Markov random fields with a non-parametric pair-wise energy function with continuous variables. The inverse problem is formulated by maximum likelihood estimation. The exact treatment of maximum likelihood estimation is intractable because of two problems: (1) it includes the evaluation of the partiti...
متن کاملGraph zeta function and loopy belief propagation
This paper discusses a link between the loopy belief propagation (LBP) algorithm and the Graph zeta function. The LBP algorithm is a nonlinear iteration to approximate the marginal or posterior probabilities required for various statistical inference, using the graph structure to define the joint probability. The theoretical properties of the LBP algorithm are not easy to analyze because of the...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/0903.4527 شماره
صفحات -
تاریخ انتشار 2009